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ROBOT CONTROL METHODS AND 
APPARATUS 

BACKGROUND OF THE INVENTION 

1. Held of the Invention 

The present invention relates to the civilian or industrial 
use of robots, more particularly to methods and an apparatus 
for the control of the pattern of action of a robot. 

2. Description of the Related Art 

When teaching action to a robot, it had been necessary to 
first program all of the desired patterns of action and their 
order and then store them in the robot or a control apparatus 
of the robot When the actions are determined by a program, 
a robot operates exactly according to the patterns of action 
described in the program. Accordingly, it was not possible to 
make the actions of the robot more diverse and there were 
limits to what could be expressed by the actions of the robot 
The expressability could not have been said to be adequate. 

Recently, as a system for control enabling the actions of 
a robot to be changed in accordance with the changing 
dynamic environment around it, the system of subsumption 
architecture for layered control of basic actions such as 
avoidance and evasion of obstructions has been proposed 
(Rodney A. Brooks, "A Robust Layered Control System for 
A Mobile Robot", IEEE Journal of Robotics and 
Automation, vol. RA-2, no. 1, March 1986). 

According to this system, when the actions belonging to 
the higher layer are not suitable for the surrounding envi- 
ronment and end in failure, the robot is constantly guided to 
take action belonging to the lower layer. When conversely 
the action belonging to the lower layer failed, however, it 
was difficult to positively guide the robot to take action 
belonging to the higher layer. 

Further, according to the subsumption architecture 
system, patterns of action were given by superposition of 
layered actions. Since however the patterns of actions con- 
tained in each layer were fixed, limitations again ended up 
being placed on the diversity of the patterns of action. 

In this way, even in the subsumption architecture system, 
over-simplification of the patterns of action of the robot 
could not be avoided and there were limits to the express- 
ability of the operations of the robot itself. 

SUMMARY OF THE INVENTION 

The present invention was made in consideration of the 
above problems in the related art and has as its object to 
provide methods and an apparatus for the control of the 
actions of a robot which enable the operations of the robot 
to be made more diversified, the matter expressable by the 
operations increased, and further the expressability of the 
operations of the robot enhanced. 

Accordingly to one aspect of the present invention, there 
is provided a robot control method for controlling the 
operation of a robot so as to pass through a plurality of states 
corresponding to a predetermined operation, comprising 
determining at least one operational arc between two 
directly passable states among the plurality of states show- 
ing the operation of the robot when passing between the two 
states, giving to each of the determined operational arcs a 
weighting coefficient corresponding to the probability of that 
operational arc being selected, selecting based on probabil- 
ity one of the operational arcs between the two states when 
making the operation of the robot pass between the two 
states based on the weighting coefficients of the operational 
arcs between the two states, and controlling the robot so as 
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to perform the operation shown by the selected operational 
arc when making the operation of the robot pass between the 
two states. 

Preferably, when making the operation of the robot pass 
5 between two or more states among the plurality of states, the 
operational arcs are selected between each two directly 
passable states among the two or more states so that the sum 
of the weighting coefficients becomes smallest. 

Preferably, the operational arc includes a self operational 
10 arc showing the operation of the robot when returning from 
one state among the plurality of states to the same one state. 

According to another aspect of the invention, there is 
provided a robot control method for controlling the opera- 
tion of a robot so as to pass through a plurality of states 
15 corresponding to a predetermined operation, comprising a 
step of receiving a starting operating state and a target 
operating state of the robot and a step of selecting a path 
giving the smallest sum of weighting coefficients when 
passing from the starting state to the target state based on a 
20 predetermined status transition chart having a plurality of 
states and given weighting coefficients showing the ease of 
passage between states. 

Preferably, at least one operational arc is defined between 
each two states, when there are a plurality of operational arcs 
^ between two states, each of those operational arcs is given 
a probability of passage showing the chance of passage, and 
one of the plurality of operational arcs between the two 
states is selected in accordance with the probability of 
passage. 

3Q According to still another aspect of the invention, there is 
provided a robot control apparatus for controlling the opera- 
tion of a robot having a plurality of states corresponding to 
a predetermined operation, at least one operational arc being 
determined between each of any two directly passable states 

35 among the plurality of states showing the operation of the 
robot when passing between the two states, comprising a 
weighting means for giving to each of the determined 
operational arcs a weighting coefficient corresponding to the 
probability of that operational arc being selected, an opera- 

40 tional arc selecting means for selecting based on probability 
one of the operational arcs between the two states when 
making the operation of the robot pass between the two 
states based on the weighting coefficients of the arcs of 
operation between the two states, an operating data produc- 

45 ing means for producing along with time operating data 
corresponding to the operation of the robot shown by the 
selected operational arc, and controlling means for control- 
ling the operation of the robot based on the produced 
operating data. 

50 Preferably, the operational arc includes a self operational 
arc showing the operation of the robot when returning from 
one state among the plurality of states to the same one state 
and the operating data producing means suppresses the 
production of the operating data corresponding to the self 

55 operational arc before the transition in states and after the 
transition in states when the states of the robot before the 
transition of states and after the transition of states coincide. 

In the methods and apparatus for control of a robot 
according to the present invention, the states corresponding 

60 to basic operations of the robot such as '"walking", "sitting", 
and "standing", the operational arcs showing the operations 
when the robot passes between two states, the self opera- 
tional arcs showing the operations for a transition in state 
within the same state, and weighting coefficients given to 

65 these operational arcs etc. are defined. 

The methods and apparatus for controlling a robot accord- 
ing to the present invention define one or more of the 
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operations when passing between two states directly pass- FIG. 1A. FIG. IB, and FIG. 1C are views showing the 

able without the intervention of another state between them external shape of a robot to which the robot control method 

among these states and select based on probability the according to the present invention is applied, in which FIG 

operauon for passing between these two states for control of iA is a front view of the robot, FIG. IB is a top plane view 

^°^ raUon f Ac /obot jo as to thereby give change to the 5 of ^ robot and FIG. 1C is a side view of the robot 

operations of the robot and increase the expressability of the A , . ^ 0 . ^ 

robot. As shown in FIGS. 1A to 1C the robot 1 has four legs 10a 

In the robot control apparatus according to the present to ^ which drivcn controUcd b y ™e robot control 

invention, the operational arc selecting means selects based methods according to the present invention. The basic 

on probability one among the plurality of selectable opera- A operations of the robot 1 called "sleeping (state 1)", "sitting 

tional arcs for passing between two directly passable states f state . 2) " "waving (state 3)", "standing (state 4**). and 

based on weighting coefficients. **walking (state 5)" are defined here as the "states** (FIG. 4 

Further, when passing through two or more states from a ctc,) - Further* when passing between such states, the robot 1 

state at the time of start of the operation to the state at the operates based on "operational arcs" which are defined in 

time of end of the operation, the operational arc selecting advance, are given weighting coefficients corresponding to 

means selects the operational arcs giving the smallest sum of 15 ^e probabilities of being selected, are selected based on the 

the weighting coefficients of the operational arcs linking two probabilities, and define operations of the robot 1 when 

states among these states. passing between these states. 

The operating data generating means generates along with FIG. 2 is a view of the configuration of the control portion 

time the operating data for realizing the movement of the used for realizing the robot control method according to the 

robot shown by the operational arc corresponding to each of 20 present invention in the robot shown in FIG. 1. 

the selected operational arcs. A . . ^ Ai _ , _ ^ 

The controWng means controls the rotation etc. of the . AS $h ° W ° " ^ X confro | P°f on 12 <* «*" * 

motors driving the robot based on the *n«i%^ ll^Z^l^T " ^ ^ " 

data, makes the robot perform the operations shown by the 12 * and a 860501 16 

selected operating data, successively executes the status 25 The control circuit 14 is comprised of a microprocessor, 

transitions, and thereby realizes a predetermined action of ROM, RAM, and peripheral circuits required for computa- 

the robot. tions. It executes the program (FIG. 3) for realizing the robot 

BRIEF DESCRIPTION OF THE DRAWINGS COrt ? 1 mCthod 9e f xdb ^ t0 P* 5 ™ 1 invention and 

. . J ^ ^ supplies operating data showing the movement of the legs 

These and other objects and features of the invention will „ \o a to 106 to the drive portions 120* to 1204 based on the 

become clearer from the following description of the pre- data defining the preset states and the sensor data etc. input 

ferred embodiments given with reference to the attached from me { 6 ^ 
drawings, in which: 

FIG. 1A. FIG. IB. and FIG. 1C are views showing the m ?* " ***** for cxam P le me cnv *onment sur- 

external shape of a robot to which the robot control method f ? undm g ^ robot 1, such as the intensity or color of the 

according to the present invention is applied, in which FIG. 35 g or tcm P craturc 40(1 me distance to the walls surround- 

1A is a front view of the robot. FIG. IB is a top plane view ing il or other rooots and 0Ut P ut s the sensor data con- 

of the robot, and FIG. 1C is a side view of the robot; cerning the surrounding environment detected to the control 

FIG. 2 is a view of the configuration of the control portion circuit 

used for realizing the robot control method according to the ^ c (fa ? ve portions 120a to 120</ are comprised of motors, 

present invention in the robot shown in FIG. 1; 40 motOT drive circuits, etc. and move the legs 10a to lOd back 

FIG. 3 is a view of the configuration of a program for and forth and U P 311(1 down based on the operating data input 

realizing the robot control method according to the present from me control ckcuix 14. That is, the control circuit 14 and 

invention; drive portions 120a to 120a 1 operate in conjunction and 

FIG. 4 is a view of the status transition chart showing the A < realize . °P eratioD of 1 in different states and the 

relationship among the states, operational arcs, and weight- °P eraUon of me robot during the transition between states, 

ing coefficients of the robot shown in FIG. 1; FIG. 3 is a view of the configuration of a program for 

FIG. 5 is a view showing N number of operational arcs realizing the robot control method according to the present 

defined between two states positioned adjoining each other invention. 

in FIG. 4 and able to be directly passed between without the Aiu The status transition reparation portion 140, path selec- 

intervention of another state; uon portion 142, arc selection portion 144. and data trans- 

FIG. 6 is a flow chart of the processing of the path mission portion 146 shown in FIG. 3 are stored in the ROM 

selection portion shown in FIG. 3; °* toe conntrol circuit 14 and are executed by the micro- 

FIG. 7 is a view showing an example of the path search. processor of the cc/trol circuit 14. 

FIG. 8 is a status transition chart giving weighting coef- 55 Operation of Status Transition Preparation Portion 

ncients to the status transition chart shown in FIG. 4, 14 q 

specifying the state 3 as the starting state, and specifying the V 

state 4 as the target state; and V^^ 6 status transition preparation portion 140 sets the 

FIG. 9 is a view of the operational arcs determined by the states P ass ed through from the state at the start of the 

status transition preparation portion, path selection portion, 60 °Peration of the robot 1 (starting state) to the state at the end 

arc selection portion, and data transmission portion shown in of ^ operation (target stafe) and prepares a status transition 

FIG. 3. chart (FIG. 4 etc.) based yn the set states and the operational 

^ _ _ arcs at the time of transition between states. 

DESCRIPTION OF THE PREFERRED t - a ^ ^ . . 

EMBODIMENTS First 11 defines in advance the states to be realized by the 

65 robot 1 and defines one or more operational arcs showing the 

Preferred embodiments of the present invention will be operation of the robot 1 at the time of transition between 

explained below. states between each two directly passable states so as to 
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make the robot 1 pass directly between the defined states. It The path selection portion 142 selects the optimal opera- 
gives to each of these defined operational arcs a weighting tional path when setting the robot 1 from the starting statTs 
coefficient corresponding to the probability of it being to the target state S, based on the status transition chart 
selected by the arc selecting portion 144. shown in FIG. 4. An "operational path" is defined as a series 

The states and operational arcs defined above can be 5 of operational arcs which starts from the starting state S a and 
expressed ma status transition chart. That is, the operational can reach the target state S g through directly connected 
arcs Aij for changing the operation of the robot 1 from the operational arcs. There are generally a plurality of opera- 
state S, to the state S; are defined for the two defined states tional paths. The path giving the smallest evaluation func- 
S, and S r tion W shown by the following equations is selected. 

The operational arcs are given the weighting coeffi- 10 

cients w i# . The operational arcs A^ included in the final w= ^ Wl (2) 

operational path can be selected from N number of opera- l 

tional arcs A*, (1^1 N). The probable weight P* 

(*=1 N) of an operational arc A k u being selected is 

shown by the following formula: 15 „, _ m i~ 1 u/ P) 

Wi- i Hv»f i 

n=0 

i= r f* (i) 

• • ■ > N Here, W x shows the sum of the weighting coefficients of 

xnr* a > • c mc operational arcs comprising the path 1 ahle to lead from 

™^ 20 the starting state S 0 to*e target st«S r I^^^ 

S^SS? operauonalarcs, and weight- ^ number of the operational arcs A,, 'omprmag this pa^ 

ing coefficients of the robot 1. Note that FIG. 4 shows single (it j=1 , 2 M, In the above f M showJjhe 

clonal arcs but fcese may be multiple arcs as well as to i number of state Js, of the status Lxtoonc^ZTn 

shown in FIG. 5. In this case, equation 1 is satisfied. in FIG 4 

For example, as shown in FIG. 4 the weighting coeffi- M Beio ^ m ^pUnxion will u ^ of ^ 

aent w l2 is given to the operational arc for the transition processing means for selecting a path, 

from the statel where the robot 1 retracts its legs 10a to lOd ~ # , . ... . 8 ^ 

under it and places its bottom down on the floor (sleeping) * as u m ? uuUaI sctUn S' two Usts for managing the 

to the state 2 where the robot 1 retracts its legs 10a and 10% states S " 1S ' a doscd ^ and 411 °P cn Usl ' de Aned. 

extends its legs 10c and lOrf, and places just its bottom at the 30 The startin g group of the closed list is an empty group. As 

side of the legs 10c and 1M down on the floor (sitting). me startin S &°up <* the open list, all states S, (i=l M) 

Further, the weighting coefficient w 14 is given to the m givcn M shown "> mc foUowin g equations: 

operational arc for the transition from the state 1 (sleeping) closed iist=$ 
to the state 4 where the robot 1 extends its legs 10a to 10a* 

and maintains its bottom parallel to the floor (standing). 35 01)01 Ust= < s i' ^ • • » s «> (*) 

SSS" ^ W l igl f lg ? >effi 5 ient Z 2i * ^ t0 * C 0pCra ' Farther, as shown by the following equation, the evalu- 

ttonal arc for the transition from the state 2 to the state 1. auon varia51es D[i] ^spending to the states S, are 

Operational arcs are defined in the same way between the defined as the initial values of the evaluation variables, 
states 1, 2, and 4 and the other two states [state 3 where the 
robot 1 alternately extends and retracts its legs 10a and 106 40 

and legs 10c and 10o* (waving) and state 5 where the robot D[i\ 
1 walks (walking)J and are given the weighting coefficients 

w 24* w 42 • • • » w 35 . Further, as shown by the following equation, the starting 

FIG. 5 shows N number of operational arcs defined state S, is made the starting connected state S . 

between two states positioned adjoining each other in FIG. 45 P 

4 and able to be directly passed between without the Sp=s * < 6) 

intervention of another state. That is, for example, it shows Next, the open list group, closed list group, evaluation 

a plurality of operational arcs even for the case of transition variables, and connected states are updated 

in state from "sleeping" to "sitting". Using the equations (7-1) and (7-2) in the following 

As shown in FIG. 5, there are N number of operational 50 equations, the open list group, closed list group, evaluation 

arcs A 12 defined between the state 1 and state 2. The variables, and connected state are repeatedly updated until 

probabilities of these N number of operational arcs A l2 S p =S 0 . 
being selected by the arc selection portion 144 are given by 

the probable weights P(l) to P(N). (7-n 

Operation of Path Selection Portion 142 55 ^ *" 
The path selection portion 142 selects a group of opera- 

tional arcs giving the smallest sum of the weighting coef- flllJ=min miM^sa.**** ™ 

ncients of the operational arcs included in an operational s, 

path based on the status transition chart prepared by the 60 „ . _ 

status transition preparation portion 140 as the operational Here - ^ statc S < saUsf > rin 8 (7-1) is updated to 

path through which the robot 1 passes fr m the starting state ^ connected state S„ as the new connected state S„. This 

to the target state. That is. there may be one or more new connected state S p is removed from the open list group 

operational arcs between any two directly passable adjoining 1Dd added t0 ^ cl ° sed Ust At this 01(1 

states included in the operational path. For example, there 65 connected state S p (° LD > becomes the parent of the new 

are more than one operational arcs for the transition from connected state S p (NEW) and ' tt connected «V P 0 * 1 "- 

"sleeping" to "sitting". s/oldv-s,(NEW) m 



0 i = 0, initial state ^ 
<*> otherwise 
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The evaluation variables D[i] are updated by equation 
(7-2) through this new connected state S„. 

Further, the pointer is followed in the closed list from the 

target state S c to obtain the series 1 of states=S c S ; 

S, S, leading to the starting state S,. At this time, the 

operational path from the starting state S, to the target state 
S a of the robot is found from the following equation by 
following the pointer in the closed list in reverse. 

Ao.i | -^A ll . l| -^A Ij . l2 -+A l2(lj -f. . . -»A, ib . 1 , Ib . 1 ->A i> . 1i0 (9) 

As explained above, with the exception of the starting 
state the A, , corresponding to the state S, through which 
the operational path passes is always selected. 

FIG. 6 is a flow chart of the processing of the path 
selection portion 142. 

As shown in FIG. 6. the path selection portion 142 as an 
initial setting makes the open list group (OPEN) all of the 
states and makes the closed list group (CLOSED) empty 
(SI). Further, it makes the starting connected state S, (S2). 

If the target state and the connected state match, the target 
state has already been reached, so the search of the state is 
ended (S3). 

The pointer is followed in the closed list group from the 
target state to the starting state to resort from the starting 
state to the target state in reverse (S7). 
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Step SI corresponds to S5, S6. S3, and S4 in the flow of 
FIG. 6. First, the smaller of D[Si| and DlSp]+W[Sp.Si| is 
selected from the open list and changed to the new D[Sil. 
Further, the Si giving the smallest D[Si) for this new D|Si] 
is found. From the table, D[S3] =1 is the smallest, so S p is 
made S3 and DfS,,] is made 1, S3 is moved from the open 
list to the closed list, and the routine proceeds to the next 
step. The candidate for the path to the smallest D[S5] at this 
point of time has not yet been found. 

Step S2 updates Df Si] in a similar manner. If the smallest 
is selected, D[S4]=3 is the smallest in the table. S p is made 
S4 and D[Sp] is made 3, then S4 is moved from the open list 
to the closed list and the routine proceeds to the next step. 
S2-S3-S5 is found as the candidate for the path to the 
smallest D[S5] at this point of time. 

At step S3, D[S5] becomes the smallest. Since S5 is the 
target, the search endshere. That is, the path of S2-S3-S5 is 
found. 

The table gives the next steps. Next, SI is the smallest 
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Due to the above processing, the series of operational arcs Operation of Arc Selection Portion 144 

^^.n^^U^i?* CXeCUUOn ° f thC 35 ™ e « sclection P«*» 144 based on probability 
*S f hi . Ml!^ , , , „ , lt% one of the operational arcs included in the operational path 
J15£7SL connected ^ * r r t selected b y * e lectio" Portion 142based on the 
^i„^£ th^X ^^°^ b,e 'a *Z °S? i St wei 8 htin 6 coefficients given to ^operational arcs. TTiat is. 
cS ™ " the " c selection Pori™ 144 selects one of the at least one 

~ group I s */- 40 operational arcs included in the operational path and present 

J^v n^ ***** P assablc stat « a ° d ^idesonthefinal 

the new connected state S p (S5). operational path. 

Further, the connected state S_ is added from the open list ~- _ - AA . ^ . . 

to the closed list and the processing of S3 is returned to (S6). ^Z J^l^ 144 bM ^. 0B P robab ^ 

Note that the processing of S4 fo S6 is repeated until the ~ ^ T" 8 aUonal . «? A % 

conditions of S3 are satisfied. 45 wh ^ each I of * e ^f* 01 * 1 A .y * ^ operational path 

Next, an explanation will be added regarding the path , a £ maht » t L? f f °5 ^ e P ath sele <*«* * the 

search ma graph giving aspect pa * sclect101 ; P°^ on * 4X u 

of FIG. 6. However, for reasons of the table and convenience , For exam P lc - whcn ^ m ^ee operational arcs able to 
in explanation, the order of "S4 M and "S5" is switched from ***** from 3,1(1 ^ probabilities are 5/8. 2/8. and 1/8. 

the flow of HG. 6. Due to the switch, the evaluation of min so when me selection processing is performed eight times these 
DfSil is "S5" and a new D[Si] is changed to. but since the m selected five ' ^ and 0De ^ respectively, 
starting state is set to S r at the initial stage, at the first "S4" processing routine of the selection first considers 

the processing is just for resetting D[Sp] to 0, so the uniform random numbers in the range of the numerical 
processing is equivalent. This method is a widely known values [Ro. RJ and defines the region [s A , e t | corresponding 

search method called the Dijkstra method. 55 t0 me operational arc A k u by the following equation. 

Next, a graph of the weighting such as shown in FIG. 7 
is considered and a path search is conducted starting from S2 \ k-i k 1 fl0 > 

and ending at S5. <*< -K>) ^AKi- K>) z^f \ 

Step SO corresponds to SI. S2. S3, and S4 in the flow of ^ 

FIG. 6. Here, the closed list is empty and the open list 60 Here, in the above quation. P* shows the probability 
contains all of 1. 2, 3, 4, and 5. Here. S p =2 is selected, coefficient and P°=0. 

everything except for D[S21 is made *>. and D[S21 is set to When the value v of the unifoorm random number is in 
0. The Si with the smallest value of D[Si] in this state is Vthe range of s Jt ^v<e ik , the/operational arc A* i;/ corresponding 
sought As shown in the table. D[S2] is the smallest. S,,=S2 to the value v of the u/tform random number is selected, 

is selected again. D|Sp| is made 0. S2 is moved from the 65 By this selection, the operational path from the starting 
open list to the closed list, then the routine proceeds to the state S, to the target state S c of the robot is defined by the 
next step. following equation using the selected operational arc A k u . 



